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question with better statistical techniques or to answer new questions with 
old data is not uncommon in quantitative studies. Meta analysis and research 
syntheses have increased with the increase in research using similar 
statistical analyses, refinements of analytical techniques, and the advent of 
computerized literature searches. No analogous definition of secondary data 
analysis from a qualitative point of view has been proposed, but the primary 
component would include analysis by a researcher removed from the process to 
continue the original analysis to address different questions or to use 
different methods to address the original research question. Discussion is 
just beginning about the possibilities of secondary analysis of qualitative 
data. A typology of secondary analysis of qualitative data is proposed that 
includes secondary analysis, meta-analysis, and collaboration for qualitative 
inquiry. A classification of models for research synthesis for qualitative 
study can be conceived of as a series of cells that embody the time of the 
analysis, reanalysis, and the data set or sets. Because qualitative analysis 
is very time intensive, considerable savings might be realized with 
reanalysis of existing data sets. Issues involved in the accessibility of 
research, its validation, and the education of researchers are discussed, as 
are concerns about the limitations of reanalysis of qualitative studies. 
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Secondary Analysis of Qualitative Data 



Quantitative and Qualitative Perspectives 



Quantitative Secondary Data Analysis 

The reanalysis of data for the purpose of answering the original research question with better 
statistical techniques or answering new questions with old data (Glass 1976). 

Meta-Analysis 

“The statistical analysis of a large collection of analysis results from individual studies 
for the purpose of integrating the findings” (p.3). 

In essence, meta-analysis is a term describing a variety of statistical procedures used to 
aggregate and quantitatively summarize the results of multiple studies on a common 
topic. The technique summarizes a set of empirical findings (usually in terms of a 
measured “effect size”) and tests their distribution for sampling error as an explanation 
for the inconsistency. Some methods (i.e., Hunter and Schmidt 1990) further adjust for 
correction of results due to statistical or methodological artifacts inherent to the studies. 

Research Synthesis 

Research synthesis (integrated research review) is a process of combining and comparing 
empirical research for the purpose of creating generalizations. This process includes: the 
a priori formulation of hypotheses and problems; the search and evaluation of the 
primary studies involved, and; the analysis and interpretation of the integrative studies. 

Research syntheses almost always (a) pay attention to relevant theories, critically analyze 
the research they cover, (b) try to resolve conflicts in the literature, and (c) attempt to 
identify central issues for future research. The statistical analysis in a research 
synthesis is what Glass termed meta-analysis (Cooper and Hedges 1994). 



Meta-analyses have proliferated since Glass’s original 1976 article introducing the concept. 
Figure 1 below illustrates the growth of meta-analyses in the literature compared between the 
social (education, psychology, and sociology) and health sciences. 



Figure 1: Health and Social Sciences Meta-Analyses Published from 1980-1993 




® Health Social Sciences 



* From Evaluation and the Health Professions, 18(3), R.B. Bausell et al., 1995, p.246. 



Three events have been credited for this proliferation of quantitative literature synthesis in recent 
years (Cooper 1 989): 

1 . The growth of research utilizing similar statistical analyses 

2. The advent of the computerized literature search 

3. The refinement of statistical procedures for aggregating similar studies (i.e., meta-analysis). 



The limitations and related misunderstandings surrounding meta-analyses are just beginning to 
be realized and discussed as summarized in Table 1 below. 



Table 1: Issues Regarding Meta-Analysis 



Source 


Issues 


Selection of Studies 

(Jeng et al. 1995; Khan, Daya, & Jadad 1996) 


• Publication Bias 

• Data Source (i.e. from the literature vs. field) 

• Quality of Studies 

• Missing Data 


Methodology 
(Hasselblad et al. 1995) 


• Which method of aggregation should be used? 

• Should quality measures of individual studies be used? 

• How are different forms of measures combined? 

• Should a Fixed-Model or Random-Model be used? 


Common Misunderstandings 
(Bangert-Drowns 1995) 


• There is one best meta-analytic method. 

• Meta-analysis is better than a narrative review. 

• Meta-analysis culminates the research in a given 
domain. 

• The most important product of a meta-analysis is the 
average effect size. 



In essence, a meta-analysis or research synthesis is a study of studies and should be thought of 
more as a perspective than a statistical technique. It is not superior to primary research or 
narrative literature review, but offers a broader interpretation of disparate studies by facilitating 
the identification of specific patterns. 



Synthesis 

An activity or product of an activity where some set of parts is combined or integrated 
into a whole. It involves some degree of conceptual innovation, or employment of 
concepts not found in the characterization of the parts as a means of creating the whole 
(Strike and Posner 1983). 

Thus, all syntheses are inductive, whether quantitative or qualitative in nature. However at this 
time the most developed ones are inductive and positivistic (i.e., meta-analysis and quantitative 
research synthesis). Syntheses which are inductive and interpretive are just beginning to receive 
attention. 
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Qualitative Secondary Data Analysis 



While no analogous definition of secondary data analysis has been offered from the qualitative 
perspective, the primary component would include the following: ... 

Analysis of qualitative data by one removed from the process with the purpose of either 
continuing the original research analysis, addressing different questions not addressed in 
the original research, or using different methods to address the original research 
questions. 

Discussion is just emerging on the possibilities of secondary analysis with qualitative data. At 
this time, the literature includes three primary discussions on the concept (Noblit and Hare 1988; 
Thorne 1994; Estabrook, Field, and Morse 1994). Table 2 summarizes the implied typology of 
the current literature. 



Table 2: Qualitative Secondary Data Analysis Typology 



Secondary Analysis Strategies 


Description 


Analytic Expansion 
(Thorne 1994) 


The primary researcher uses the original database to progress to the next level of analysis or 
explore new and evolving questions as theory emerges. 


Retrospective Interpretation 
(Thorne 1994) 


New or unanswered research questions are explored from the data which were not fully 
examined or explained in the original research study. 


Armchair Induction 
(Thorne 1994) 


Textual or content analysis by those experienced in theory development and talents lie 
therein, rather than the phenomenon under investigation. 


Amplified Sampling 
(Thome 1994) 


The development of broader theories through comparison of several distinct and 
theoretically representative databases. 


Cross-Validation 
(Thorne 1994) 


Other databases are used by the researcher to confirm or discount new findings and/or 
suggest patterns related to his/her own sample and research. 


Meta-Ethnography 
(Noblit & Hare 1988) 


The comparative textual analysis of published field studies through the translation of 
qualitative studies into one another, and as such, avoids the aggregation of studies 
attempting to create generalizations and general conclusions. j 


Aggregated Analysis 
(Estabrook et al. 1994) 


Aggregation, analysis, and synthesis of the findings (i.e., not the original data) of multiple 
studies for the primary purpose of developing mid-range theory. 
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Conceptually, I would propose a typology more intuitive to that of a research synthesis which 
would include three basic approaches as illustrated in Figure 2: 



Figure 2: Approaches to Qualitative Research Synthesis 




Secondary Analysis: Analysis of an existing qualitative database, or databases, for the purpose 

of reviewing the literature, answering the original research question(s) 
using different methods, or answering new questions with “old” data. 

Meta- Analysis: An analysis of the results or original data from multiple studies. The 

inductive integration of interpretive studies (published or unpublished) so 
they may be reduced, compared and translated as a way of synthesizing 
knowledge. 

Collaboration: The joint intellectual effort involving the on-going interaction of 

qualitative researchers, and any stakeholders outside the context of the 
study (e.g., policymakers, evaluators, practitioners), contributing to the 
interpretive process of qualitative inquiry. 
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Research Syntheses: 
Classification of 




No Data Data 

Reanalysis Reanalysis 



Review of Models 



Cell 1: After-the-fact analysis/no reanalysis/single data set 



A critical review of a study by someone who does not have access to the primary data and 
consequently critiques/discusses the primary research based upon: 

• methodological considerations 

• examining the data as presented (e.g., text, narratives, etc.) 

• interpreting the data which is presented 

Ex.: • Editorial/review in a journal in response to a published article or book. 

• Hickson, G.B., Clayton, E.W., Entman, S.S., Miller, C.S., Githens, P.B., Whetten- 
Goldstein, K., & Sloan, F. (1994). Obstetricians’ prior malpractice experience and 
patients’ satisfaction with care. Obstetrical & Gynecological Survey, 50, 35 1 -353. 

Cell 2: After-the-fact analysis/data reanalysis/single data set 

I perceive this cell representing where most of the qualitative secondary analyses have and will 
occur, however from two different perspectives or goals: 

• Using the primary data to either continue investigation of the original research question 
or to address new research questions. This may either involve the re-analysis of the 
primary data of a single study or of a large archived qualitative database. 

Ex.: • Handout (PIPP) 

• Murdock, G. Outline of Cultural Materials. Human Relations Area Files, Inc. 
New Haven, CT. 

• Murdock, G. Outline of World Cultures. Human Relations Area Files, Inc. 

New Haven, CT. 




6 10 



• Mead, J.V. (1993). A guide to the Teacher Education and Learning To Teach 
Database. (Technical Series 93-2). East Lansing: Michigan State University, 
National Center for Research on Teacher Learning. 

• McGrath, J.W. (1991). Biological impact of social disruption resulting from 
epidemic disease. American Journal of Physical Anthropology, 84, 407-419. 

• The audit of an entire study may be one goal of a secondary analysis for the purpose of 
establishing credibility (e.g., validity). An audit may be either independent of the 
primary investigator(s) or an actual component of the primary research design. Audits 
usually involve a series of steps similar to those proposed by Schwandt and Halpern 
(1988) for evaluation studies. 

Ex.: Handout (LB506 and AHCPR) 

Cell 3: Simultaneous analysis/no data reanalysis/single data set 

This cell represents two potential applications. The first is what McCracken (1988) refers to as 
“commissioned” qualitative research in which an administrator conducts the investigation from a 
distance through directing the work of others. As defined, "This may be a project director of a 
large omnibus project or the party charged with commissioning single, purpose-built pieces of ad 
hoc research" (p.59). 

Ex: • Handout (AHCPR). 

The second application is more along the line of consultants and research advisory boards who 
are contracted to assist with a research study. The optimal use of such individuals is that as 
simultaneous "reviewers" throughout the time frame of the study - posing alternative 
explanations of interpretations, critiquing data collected and analyzed, and providing insight 
from the interpretations shared with them. A more commonly used approach is to hire 
consultants for special sessions or retreats with the primary investigators for similar reasons. 

Ex.: • Handout (AHCPR.) 
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Cell 4: Simultaneous analysis/data reanalysis/single data set 



Within this cell is where most qualitative collaborative research occurs. This most likely 
involves a team approach where division of labor is accomplished at different levels. For 
example, you may have specific investigators responsible for the fieldwork, while others for 
analysis. It may also be feasible for the analysts to work separately, thus allowing the pursuit of 
different questions/issues they view as important. 

Ex.: • Handout (AHCPR) 

• Liggett, A.M., Glesne, C.E., Johnston, A.P., Hasazi, S.B., & Schattman, R.A. (1994). 
Teaming in qualitative research: Lessons learned. Qualitative Studies in Education, 

7(1), 77-89. 

• McVea, K., Crabtree, B.F., Medder, J.D., Susman, J.L., Lukas, L., Mcllvain, H.E., 
Davis, C.M., Gilbert, C.S., & Hawver, M. (1996). An ounce of prevention? Evaluation 
of the “put prevention into practice” program. Journal of Family Practice, 43, 361-369. 

• Vogt, E.Z. & Albert, E.M. (Eds.) (1967). People ofRimrock: A Study of Values in 
Five Cultures. Cambridge, MA: Harvard University Press. 

• Whiting, B.B. & Whiting, J.W. (1975). Children of Six Cultures: A Psycho-Cultural 
Analysis. Cambridge, MA: Harvard University Press. 

Cell 5: After-the-fact analysis/no data reanalysis/multiple data sets 

This cell is most analogous to the quantitative meta-analysis and literature synthesis through its 
focus upon synthesizing the results of multiple studies/databases. As with its quantitative 
counterpart, there are specific issues needing to be addressed or acknowledged as identified 
earlier in Table 1, and summarized as follows: 

• Sampling: how and which studies are chosen (e.g., published vs. unpublished studies) 

• Quality control: deciding which studies to include and which to exclude based on their 
quality 

• Relevance: after deciding on quality, then one must decide which high quality studies 
are of greatest relevance. 
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• Results: how does one deal with inconsistent findings and missing data. 

The problems are accentuated in this cell, as opposed to the next cell (Cell 6), because the 
secondary analyst is not privy to the original data of the studies. 

Ex.: • Corbin, J. & Strauss, A.L. (1987). Accompaniments of chronic illness: Changes in 

body, self, biography, and biographical time. Research in the Sociology of Health Care, 

6, 249-281. 

Cell 6: After-the-fact analysis/data reanalysis/multiple data sets 

This cell is more along the line of Noblit and Hare's Meta-ethnography (1988) in that the 
secondary analyst is interested in synthesizing multiple studies through the analysis of the 
original data. Here the key issue becomes how to combine the data of studies and is most useful 
for those wishing to review the qualitative literature on some area of interest. 



Cell 7: Simultaneous analysis/no data reanalysis/multiple data sets 

This cell is rarely realized in contemporary qualitative researcher. It basically consists of a 
secondary analyst or "meta-analyst" who is commissioned to oversee two or more related studies 
concurrently under investigation. This could possible occur in the larger national funding 
agencies and would have some definite advantages which will be discussed in the final cell. 

Cell 8: Simultaneous analysis/data reanalysis/multiple data sets 

This model is more along the lines of programmatic research and consists of running two or more 
studies back-to-back, or consecutively, beginning one study immediately after the other study's 
data collection and analysis are completed, but no final report has been published. The 
advantage to this model is that one can learn from the mistakes and insights of the preceding 
study to help inform the subsequent one. They also prove helpful for purposes of generalizations 
and theory development through replication and modification. However, a limitation is that such 
studies may be prohibitively expensive. 

Ex.: • Handout (DOPC, LB506 study, and AHCPR) 
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Rationale 



1 . Review of Literature 

Researchers may wish to gain new knowldege by comparing across studies within a specific 
subject area of interest, or even reanalyze a specific study of interest. The knowledge and insight 
gained by many qualitative studies is not static. The knowledge gleaned in the original research 
may be progressed by the new insight or "lens" of other researchers. Likewise, such progress of 
knowledge may be realized through the passing of time. New insights, theories, and studies may 
evolve which are very pertinent and give an added perspective useful to the original research. 
Secondary analysis would provide the opportunity to re-enter the original research and develop a 
new layer of analysis. 



2. Economy 

Qualitative research is very time intensive, beginning well before the data collection (e.g., issues 
of gaining access) and continuing after (e.g., analysis and verification). It is not uncommon for a 
qualitative database to represent years of work by the primary investigator and substantial 
funding through a variety of sources (e.g., universities, grant agencies). Considerable time, 
money, and personnel could be saved through secondary analysis of an already existent data base 
or a research team approach. 

This may becoming a critical and viable issue for qualitative researchers. The attenuation of 
federal funding for research appears inevitable. The implications, according to some, is that the 
future for many researchers lies in private industry funding (Morone and Belkin, 1995). Such 
funding frequently comes with inherent agendas which most likely include the economy of 
resources and a historical predominance of quantitative research. While qualitative research is 
recognized as useful, it is often viewed as prohibitive in terms of time, personnel and money. 
Future funding for research, regardless of methodology, will most likely have a strong 
component based on economic restraint related to what useful outcomes are generated by such 
research. 
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3. Accessiblity 



Gaining access through gatekeepers can be difficult, depending on the focus of the study. 
Analysis of an already existent database which has addressed such an issue may be advantageous 
in such cases. Likewise, collaborating with individuals with access to an otherwise restrictive 
field of interest may be the only way of obtaining the data necessary for a specific study. 

There are cases which involve the study of rare events or infrequent cyclic occurrences in a life 
cycle of an individual or sample of interest. Secondary analysis may provide a unique 
opportunity to access otherwise unique and scarce data. 



4. Verification (Validation) Through Triangulation 

Triangulation is not a tool or a strategy of validation, but an alternative to validation (Fielding 
and Fielding 1986, Denzin 1989a, 1989b, Flick 1992). Denzin (1978) and Janesick (1994) 
identified five types of triangulation: data, investigator, theory, methods, and disciplinary. The 
combination of multiple methods, data types, theory, perspectives and observers in a single study 
is best understood, then, as a strategy that adds rigor, breadth, and depth to any investigation. 

Unfortunately, many qualitative researchers primarily think of triangulation in terms of data 
triangulation and more recently, secondarily as methodological triangulation. With regards to 
investigator and interdisciplinary triangulation, such approaches are usually incorporated into an 
audit as a "post hoc" form of verification. I believe that such forms of triangulation when 
incorporated into the methods of a research synthesis aid in verification by narrowing the 
distance between the field and the analyst(s). 

5. Education/Training 

The reanalysis of data from original investigations can be fundamental in the training of 
researchers, evaluators, and practitioners. In fact, it may be more ubiquitous to training than to 
research per se. If such use of secondary analyses are successful in educating others regarding 
the solutions, or possible solutions, to the problems which arise in collecting, analyzing, and 
interpreting data, a subsequent outcome may be the improvement in the quality of primary 
research. 
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Limitations/Issues 



1. Field Absence 

With qualitative studies, the researcher is the research instrument (Guba and Lincoln 1981; 
Patton 1990; Bogdan and Biklen 1992; Marshall and Rossman 1995). One brings their own 
unique experiences, perspective or "lens", bias, and interpretive style to the collection of data and 
analysis. The absence of the secondary data analyst from the data collection raises serious 
questions regarding the misinterpretation of the data. There may be no substitute for the 
intimacy and context one develops with their data when it comes time to "make sense" of it at the 
analysis stage. 

I would suggest that this problem may be the result of the specific qualitative strategy used. As 
discussed by Creswell (1995), the importance of the research's presence in the study and the 
relative weight given to description varies with different strategies (Figure 4). 



Figure 4: A Comparison of Five Strategies 



Relative Weight for Description 



Minimal 


P 


GT 


C 


E 


B 


Substantial 




Researcher s Presence 




Background 


GT 


P 


B 


C 


E 


Forefront 



B = Biography C = Case Study E = Ethnography GT = Grounded Theory P = Phenomenology 



* From Qualitative Strategies of Inquiry and Design Procedures, J.W. Creswell, 1995. 



For example, substantial weight on thick description is seen with a case study and ethnography 
while less is emphasized in phenomenology and grounded theory. The presence of the researcher 
from data collection to the actual write-up is seen as being in the forefront with an ethnography 
whereas, the researcher is more in the background with a grounded theory and phenomenological 
study. Such issues need further investigation, but at this time, it appears intuitive that specific 
qualitative strategies may be more accessible to secondary analysis than others. 

2. Lazy Research 

Thome (1994) describes "lazy research" as data sets which are used due to their convenience, and 
as a result, become overly available and overused. This often will result in exaggeration and 
misinterpretation of any of the peculiarities of the overused sample database. 

I would also extend this to those researchers, for whatever reason, merely want to avoid the time 
and inconvenience of data collection. This is also not uncommon in the quantitative arena - there 
are those who do not want to go through the inconvenience of random assignment, and therefore 
will perform excessive covariance procedures (e.g., ANCOVA, MANCOVA) in attempts to 
minimize any systematic bias in the treatment groups. Frequently, this may cause a subsequent 
decrease in the statistical power and findings. Researchers needs to defend their means of 
analysis regardless of methodology. 

3. Ethical Issues 

As previously discussed, the rationale for secondary analysis relate to economy and access 
issues. The researcher may be able to avoid such issues as gaining access, identifying willing 
informants, and a variety of IRB-based requirements. However, if the secondary analysis is 
being conducted with a new and different research question than the original research, one should 
not assume that the original informants' complied consent is universal or omnipresent. This 
raises specific ethical considerations not only for the secondary analyst, but also the original 
researcher who is making his/her data set available for such purposes. 
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Considerations 



I would propose the following six questions be considered by any qualitative researcher 
contemplating a secondary analysis. 

1 . What is the specific qualitative strategy employed by the study? 

Due to the pivotal and variable role of the researcher in the different qualitative strategies, certain 
ones may be conceived as more viable than others. A continuation of this question is to also 
evaluate the qualitative design for any flaws which would interfere with the data analysis. 
Questions needing to be asked are: Does the strategy match the research question?; Are the 
appropriate types of data present for the specific strategy?; and, Are appropriate techniques used 
by the data collector? 

2. Who was responsible for the original data collection and will they be available to you 
throughout the analysis? 

At the risk of being redundant, the researcher is the research instrument. The training and 
expertise of the researcher conducting the data collection is critical. Also, since numerous 
questions or problems may occur during the secondary analysis, one may need to ask the data 
collector specific questions regarding the data which only he/she could answer. 

3. What is the quality of the data? 

The data needs to be carefully scrutinized for its representiveness of the particular qualitative 
strategy and its overall quality for credibility reasons. 

4. What is the format in which the data is stored? 

Data accurately transcribed and imported into a qualitative software package is more accessible, 
organized, and easier to work with than the researcher's original data and notes, or their remnants 
after the original analysis. Through the increased use of computer software for data analysis, 
secondary data analysis may already be currently used more than realized. 
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5. Are there supplementary data types which may be helpful? 



As identified by Denzin (1978), there are four basic types of triangulation; data, investigator, 
theory, and methodological triangulation. The importance of data triangulation cannot be over 
emphasized with regards to secondary data analysis. The use of all types of data collected, 
regardless of the intended or original use in the study, should be evaluated for their usefulness in 
narrowing the distance between the data collection and the analyst. 

6. How will the final product be written and used? 

The question of how, or whether, the use of secondary data analysis will be discussed in the final 
project is difficult to answer. With the emphasis by editors for parsimony and the descriptive 
and interpretive demands of qualitative studies, authors must frequently be concerned about the 
length and content of their manuscript. Shortening the methodology section for the sake of 
keeping the narratives, descriptive data, and interpretive analyses, is probably the path of least 
resistance. It is much easier, and raises less methodological questions, to explain the 
methodology from the standpoint of a research "team" approach, rather than discussing the role 
of each. Until more inquiry and discussion on the use of secondary analysis is realized, its 
acknowledgment in the literature will most likely remain obscured. 




15 



References/Reading List 



Meta-Analysis and Research Synthesis 

Bangert-Drowns, R.L. (1995). Misunderstanding meta-analysis. Evaluation & the Health 
Professions, 18, 304-314. 

Bausell, R.B., Li, Y., Gau, M., & Soeken, K.L. (1995). The growth of meta-analytic literature 
from 1980 to 1993. Evaluation & the Health Professions, 18, 238-251. 

Cook, T., Cooper, H., Corday, D., Hartmann, H., Hedges, L., Light, R., Louis, T., & 

Mosteller, F. (Eds.). (1992). Meta-Analysis for Explanation: A Casebook. New York: 
Russell Sage. 

Cooper, H., & Hedges, L.V. (1994). The Handbook of Research Synthesis. New York: Russell 

Sage. 

Cooper, H., & Hedges, L.V. (Eds.) (1994). The Handbook of Research Synthesis. New York: 
Russell Sage Foundation. 

Cooper, H.M. (1989). Integrating Research: A Guide for Literature Reviews. Newbury Park, 
CA: Sage. 

Cooper, H.M. (1989). Integrating Research: A Guide for Literature Reviews. Newbury Park, 
CA: Sage. 

Farley, J.U., & Lehmann, F.R. (1986). Meta-Analysis in Marketing: Generalization of 
Response Models. Lexington, MA: Lexington Books. 

Glass, G.V. (1976). Primary, secondary, and meta-analysis of research. Educational 
Researcher, 5, 3-8. 

Glass, G.V., McGaw, B., & Smith, M.L. (1981). Meta-Analysis in Social Research. 

Beverly Hills, CA: Sage. 

Hasselblad, V., Mosteller, F., Littenberg, B., Chalmers, T.C., Hunink, M.G., Turner, J.A., 
Morton, S.C., Diehr, P., Wong, J.B., & Powe, N.R. (1995). A survey of current 
problems in meta-analysis: Discussion from the agency for health care policy and 
research inter-PORT work group on literature review/meta-analysis. Medical Care, 

33(2), 202-220. 



O 

ERIC 



16 



20 



Hedges, L.V., & Olkin, I. (1985). Statistical Methods for Meta-Analysis. Orlando, FL: 
Academic Press. 

Hunter, J.E., & Schmidt, F.L. (1990). Methods of Meta-Analysis: Correcting Error and Bias in 
Research Findings. Newbury Park, CA: Sage. 

Jeng, G.T., Scott, J.R., & Burmeister, L.F. (1995). A comparison of meta-analytic results using 
literature vs. individual patient data. Journal of the American Medical Association, 274, 
830-836. 

Khan, K.S., Daya, S., & Jadad, A.R. (1996). The importance of quality of primary studies in 
producing unbiased systematic reviews. Archives of Internal Medicine, 156, 661-666. 

Light, R.J., & Pillemer, D.B. (1984). Summing Up: The Science of Reviewing research. 
Cambridge, MA: Harvard University Press. 

Rosenthal, R. (1991). Meta-Analytic Procedures for Social Research. Beverly Hills, CA: Sage. 

Wachter, K.W., & Straf, M.L. (Eds.). (1990). The Future of Meta- Analysis. New York: Russell 
Sage. 

Wolf, F. (1986). Meta-Analysis: Quantitative Methods for Research Synthesis. Beverly Hills, 
CA: Sage. 



Qualitative Secondary Data Analysis 
Conceptual 



Chappel, N.L. (1995). Gerontological research in the 90's: Strengths, weaknesses and 
contributions to policy. Canadian Journal on Aging, 14(supplement 1), 23-36. 

Day, C. (1991). Roles and relationships in qualitative research on teachers' thinking: A 
reconsideration. Teaching and Teacher Education, 7(5-6), 537-547 . 

Dzurec, L.C. (1990). Research to understand living with diabetes. Diabetes Education, 16(4), 
276-281. 

Estabrooks, C.A., Field, P.A., & Morse, J.M. (1994). Aggregating qualitative findings: An 

approach to theory development. Qualitative Health Research, 4(4), 503-5 1 1 . 

Gottlieb, A. (1995). Beyond the lonely anthropologist: Collaboration in research and 
writing. American Anthropologist, 97(1), 21-26. 




17 



21 



Gudeman, S., & Rivera, A. (1995). From car to house (del coche a la casa). American 
Anthropologist, 97(2), 242-249. 

Kennedy, E.L. (1995). In pursuit of connection: Reflections on collaborative work. 

American Anthropologist, 97(1), 26-33. 

Liggett, A.M., Glesne, C.E., Johnston, A.P., Hasazi, S.B., & Schattman, R.A. (1994). 

Teaming in qualitative research: Lessons learned. Qualitative Studies in Education, 7(1), 
77-89. 



McCracken, G. (1988). The Long Interview . Newbury Park, CA: Sage. 

Miller, J.L. (1992). Exploring power and authority issues in a collaborative research 
project. Theory into Practice, 31(1), 165-172. 

Noblit, G.W. & Hare, R.D. (1988). Meta-ethnography: Synthesizing Qualitative Studies. 
Newbury Park, CA: Sage. 

Rorty, R. (1991). Objectivity, Relativism, Truth. Cambridge, MA: Cambridge University 
Press. 

Smulyan, L. (1988). The collaborative process in action research. Educational Research 
Quarterly, 12(1), 47-56. 

Stillinger, J. (1991). Multiple authorship and the myth of solitary genius. New York: Oxford 
Press. 

Strike, K. & Posner, G. (1983). Types of synthesis and their criteria. In S.Ware and L. Reed 
(Eds.) Knowledge Structure and Use. Philadelphia: Temple University Press. 

Thorne, S. (1994). Secondary analysis in qualitative research: Issues and implications. In 
J.M. Morse (Ed.), Critical Issues in Qualitative Research Methods (pp. 263-279). 
Thousand Oaks, CA: Sage. 

Wasser, J.D., & Bresler, L. Working in the interpretive zone: Conceptualizing collaboration in 
qualitative research teams. Educational Researcher, 25(5), 5-15. 



Applied 

Cohen, M.H. (1995). The triggers of heightened parental uncertainty in chronic, life- 
threatening childhood illness. Qualitative Health Research, 5(1), 63-77 . 




18 



22 



Corbin, J., & Strauss, A.L. (1987). Accompaniments of chronic illness: Changes in body, self, 
biography, and biographical time. Research in the Sociology of Health Care, 6, 249-28 1 . 

McGrath, J.W. (1991). Biological impact of social disruption resulting from epidemic 
disease. American Journal of Physical Anthropology, 84, 407-419. 

McVea, K., Crabtree, B.F., Medder, J.D., Susman, J.L., Lukas, L., Mcllvain, H.E., Davis, C.M., 
Gilbert, C.S., & Hawver, M. (1996). An ounce of prevention? Evaluation of the “put 
prevention into practice” program. Journal of Family Practice, 43, 361-369. 

Sandelowski, M. (1994). Channel of desire: Fetal ultrasonography in two use-contexts. 
Qualitative Health Research, 4(3), 262-280. 

Susman, J.L., Crabtree, B.F., & Essink, G. (1995). Depression in rural family practice. Easy to 
recognize, difficult to diagnose. Archives of Family Medicine, 4, 427-43 1 . 

Ventres, W., Nichter, M., Reed, R., & Frankel, R. (1992). Do-not-resuscitate discussions: A 
qualitative analysis. Framily Practice Research Journal, 12, 157-169. 

Webb, G., Ladipo, E.Q., & McNamara, R. (1991). Qualitative methods in operations 

research on contraceptive distribution systems: A case study from Nigeria. Social 
Science and Medicine, 33(3), 321-326. 

Whiting, B.B. (Ed.) (1963). Six Cultures: Studies of Child Rearing. New York: John 
Wiley and Sons, Inc. 

Whiting, B.B. & Whiting, J.W. (1975). Children of Six Cultures: A Psycho-Cultural Analysis. 
Cambridge, MA: Harvard University Press. 

Willms, D.G., Besst, J.A., Taylor, D.W., Gilbert, J.R., Wilson, D.M., Lindsay, E.A., Singer, J. 
(1990). A systematic approach for using qualitative methods in primary prevention 
research. Medical Anthropology Quarterly, 4,391-409. 



Qualitative Computer Analvsis/Databases 



Bassett, R., Cox, S., & Rauch, U. (1995). The emperor's new clothes: Is there more to 
NUDIST than meets the eye? A response to Wall's concerns about software for 
qualitative data analysis. Society - Societe, 19(2), 18-23. 

Gerson, E.M. (1984). Qualitative research and the computer. Qualitative Sociology, 7, 61-74. 

Gerson, E.M. (1988). Computing in qualitative sociology: A cautious hurrah. Qualitative 
Sociology, 11(3), 252-256. 




19 



23 



Mead, J.V. (1994). Some issues in constructing, managing, and using large qualitative 
databases. Midwestern Educational Researcher, 7(2), 8-14. 

Tesch, R. (1990). Qualitative Research: Analysis Types and Software Tools. New York: 
Falmer. 

Weitzman, E.A. & Miles, M.B. (1995). Computer Programs for Qualitative Data 
Analysis. Thousand Oaks, CA: Sage. 

Wall, E. (1995). The problem with NUDISTs. Society - So ciete, 19(1), 13-14. 



General Qualitative References 

Bogdan, R. & Bilken, S.K. (1992). Qualitative Research for Education (2nd edition). 

Boston, MA: Allyn and Bacon. 

Creswell, J.W. (1995, November). Qualitative Strategies of Inquiry and Design Procedures. 
Paper presented at the annual meeting of the Association for the Study of Higher 
Education, Orlando, Florida. 

Denzin, N.K. (1978). The research act: A theoretical introduction to sociological 
methods (2nd ed.). New York: McGraw-Hill 

Guba, E.S. & Lincoln, Y.S. (1981). Effective Evaluation.. San Francisco: Jossey-Bass. 

Marshall, C., & Rossman, G.B. (1995). Designing Qualitative Research (2nd Ed.). 

Thousand Oaks, CA: Sage. 

Morone, J.A., & Belkin, G.S. (1995, August). The science illusion: And the triumph of 

medical capitalism. Paper presented at the American Political Science Association, 
Chicago, II. 

Patton, M.Q. (1990). Qualitative Evaluation and Research Methods. (2nd Ed.). Newbury 
Park, CA: Sage. 

Strauss, A. & Corbin, J. (1994). Grounded theory methodology: An overview. In N.K. Denzin 
& Y.S. Lincoln (Eds.), Handbook of Qualitative Research (pp. 273- 285). Thousand 
Oaks, CA: Sage. 



24 

ERIC 



20 



Collaboration - Primary analysis 



CL 

Q- 

CL 

<D 

O 

'P 

o 

(0 

k. 

CL 

o 

c 

c 

o 

'p 

c 

<D 

> 

<D 



3 

CL 





LB506: Successful Cancer Prevention Strategies in Primary Care 




O 

ERIC 









< 

s 

6 



it 

13 



£ 

o 




3 









O' 



AHCPR: Prevention and Competing Demands in Primary Care 




0 





ft* 

.a 



I 



u 

3 

a 

Q 



Cases 2-8 


•repeat j 

process as j 

described | 

for Case 1 


•writing of 1 
case study 
summaries 
continued 


•receive and 
review case 
study 
summaries 
from 
previous 
block and 1 

“audit** ■ j 


Case 1 
Weeks 7-8 


•observe & 
interview 
focusing on 
follow-up 
concerns 

•conduct 

indepth 

interviews 

•conduct 
focus group 
interviews 


•write initial 
summaries 
for 2 case 
studies & 
send to 
auditors 




Case 1 
Week 6 


•work in 
UNMC 
office and 
review 
fieldnotes 
and expand 
if necessary 

•arrange 
focus groups 
with patients 


• intensive 
review of 
weeks 1-5 
notes and 
suggest 
follow-up 
questions for 
week 8 




Case 1 
Weeks 4-5 


•participate 
as office 
nurse 


•review 
weeks 2-3 
notes and 
provide 
feedback 




Case 1 
Weeks 2-3 


•key 

informant 

interviews 

•observe in 
practice 

•collect 
material on 
prevention 


•review 1 

week 1 notes 
and provide 
feedback 




Case 1 
Week 1 


•orient to 
practice & 
develop 
rapport with 
staff 

•observe 
patient care 
of each 
physician in 
practice 








| Research 
| Nunes 


UNMC 
Study Team 

2 teams: 

•research 

nurse 

•2 analysts 


Auditors (2) 



CQ 



« 



Distance from Field 




Direct Observation of Primary Care (DOPC) 






g .2 

o u 
ra > 

2 -c 

Q. Q. 

^ s 

00 J2 

II ^ 



c 




CV3 

>00 



2 

0) 




■ ' 



CTi 





Trt'dv-'Wgy 

® 

U.S. Department of Education 

Office of Educational Research and Improvement (OERI) 

Educational Resources Information Center (ERIC) 

REPRODUCTION RELEASE 

(Specific Document) 




I. DOCUMENT IDENTIFICATION: 



Title: 



O f d>K>«i.nA nj£ X>A~TA 



Aulho>(s): ft. znEJ&Z* 



Corporate Source: 



1 Publication Date: 

i 



II. REPRODUCTION RELEASE: 



In order to disseminate as widely as possible timely and significant materials of interest to the educational community, documents announced 
in the monthly abstract journal of the ERIC system, Resources in Education (RIE), are usually made available to users in microfiche, reproduced 
paper copy, and electronic/optical media, and sold through the ERIC Document Reproduction Service (EDRS) or other ERIC vendors. Credit is 
given to the source of each document, and, if reproduction release is granted, one of the following notices is affixed to the document 

If permission is granted to reproduce and disseminate the identified document please CHECK ONE of the following two options and sign at 
the bottom of the page. 



□ 

Check here 
For Level 1 Release: 

Permitting reproduction in 
microfiche (4* x 6" film) or 
other ERIC archival media 
(e.g., electronic or optical) 
and paper copy. 



The sample sticker shown below will be The sample sticker shown below will be 
affixed to all Level 1 documents affixed to all Level 2 documents 



Check here 
For Level 2 Release: 

Permitting reproduction in 
microfiche (4 - x 6" film) or 
other ERIC archival media 
(e.g., electronic or optical), 
but not in paper copy. 



PERMISSION TO REPRODUCE AND 




PERMISSION TO REPRODUCE AND 


DISSEMINATE THIS MATERIAL 




DISSEMINATE THIS 


HAS BEEN GRANTED BY 




MATERIAL IN OTHER THAN PAPER 






COPY HAS BEEN GRANTED BY 


AO 






J 

cP 




Jr 

— — — c5k* 








TO THE EDUCATIONAL RESOURCES 




TO THE EDUCATIONAL RESOURCES 


INFORMATION CENTER (ERIC) 




INFORMATION CENTER (ERIC) 




Level 1 



Level 2 



Documents will be processed as indicated provided reproduction quality permits. If permission 
to reproduce is granted, but neither box is checked, documents will be processed at Level 1. 



Sign 

here-* 

please 




'thereby grant to the Educational Resources Information Center (ERIC) nonexclusive permission to reproduce and disseminate 
this document as indicated above. Reproduction from the ERIC microfiche or electronic/optica 1 media by persons other than 
ERIC employees and its system contractors requires permission from the copyright holder. Exception is made for non-profit 
reproduction by libraries and other service agencies to satisfy information needs of educators in response to discrete inquiries . ' 


Signature: 


Printed Name/Position/Tide: 


Or g an izaitio n/A cfc) re s s : 

oi‘ /d&i&Kt A fflZOtCJxL 

600 5. S-T t Qey 30^6 

Omaha 48^8“3o7 5 ' 


TelepFiorie: j PAX: 

§*>2.) 56 9- w 5« K^oi) 5*?- g/ 1 $ 


\ E-Mail Address: [Date: 

1 .LMrttC. ^ t 




CCA , 




THE CATHOLIC UNIVERSITY OF AMERICA 

Department of Education, O’ Boyle Hall 
Washington, DC 20064 

800 464-3742 (Go4-ERIC) 



April 25, 1997 
Dear AERA Presenter, 

Hopefully, the convention was a productive and rewarding event. We feel you have a 
responsibility to make your paper readily available. If you haven’t done so already, please submit 
copies of your papers for consideration for inclusion in the ERIC database. If you have submitted 
your paper, you can track its progress at http://ericae2.educ.cua.edu. 

Abstracts of papers accepted by ERIC appear in Resources in Education (RIE) and are announced 
to over 5,000 organizations. The inclusion of your work makes it readily available to other 
researchers, provides a permanent archive, and enhances the quality of RIE. Abstracts of your 
contribution will be accessible through the printed and electronic versions of RIE. The paper will 
be available through the microfiche collections that are housed at libraries around the world and 
through the ERIC Document Reproduction Service. 

We are soliciting all the AERA Conference papers and will route your paper to the appropriate 
clearinghouse. You will be notified if your paper meets ERIC's criteria for inclusion in RIE : 
contribution to education, timeliness, relevance, methodology, effectiveness of presentation, and 
reproduction quality. 

Please sign the Reproduction Release Form on the back of this letter and stet two copies of your 
paper. The Release Form gives ERIC permission to make and distribute copies of your paper. It 
does not preclude you from publishing your work. You can mail your paper to our attention at the 
address below. Please feel free to copy the form for future or additional submissions. 

Mail to: AERA 1997/ERIC Acquisitions 

The Catholic University of America 
O'Boyle Hall, Room 210 
Washington, DC 20064 




Lawrence M. Rudner, Ph.D. 
Director, ERIC/E 



® 



Clearinghouse on Assessment and Evaluation 





